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DYNAMIC  LINEAR  MODELS  WITH  LEADING  INDICATORS 

by 

Jingxian  Chen 


Abstract 


This  thesis  proposes  a  dynamic  linear  model  (DLM)  to  deal  with  the  problem  of 
forecasting  with  leading  indicators.  We  call  this  type  of  a  DLM  as  a  dynamic  linear  model  with 
leading  indicators.  Our  approach  expands  the  conventional  one-dimension  DLMs  to  the  two- 
dimension  case.  Analyses  of  some  real  data  sets  which  initially  motivated  us  to  explore  our 
approach,  are  used  as  applications.  For  reasons  of  confidentiality  they  have  been  coded  as  Data 
Set  One,  Data  Set  Two  and  Data  Set  Three,  respectively.  Our  approach  has  a  much  wider  field 
of  application,  for  instances,  the  two-dimension  filter  problems  m  image  processing,  and 
estimatioa  problems  related  to  Markov  random  fields. 


«  a  1 


1.  TNTRODUCTTON  AND  OVERVIEW 


The  problem  addressed  in  this  thesis  is  to  expand  upon  the  dynamic  linear  model  (DLM), 
such  that  it  can  deal  with  leading  indicators.  It  is  motivated  by  the  analysis  of  three  time  series 
data  sets  listed  in  Tables  1.1  -  1.3,  whose  plots  are  shown  in  Figures  1.1  -  1.3.  Each  data  set 
involves  several  series;  for  example,  Data  Set  One  consists  of  six  series.  From  those  plots, 
particularly  from  Figure  1.1,  one  can  perceive  that  there  may  exist  a  pattern  common  to  all  the 
series  within  the  set.  For  instance,  all  the  six  series  of  Data  Set  One  reveal  an  ’S’  shaped  pattern. 
This  phenomenon  motivates  us  to  think  of  introducing  a  leading  indicator  series  into  the  DLM  to 
improve  the  forecasts  of  a  series  of  interest.  For  example,  if  we  want  to  forecast  series  6  of  data 
set  one,  we  may  want  to  use  data  from  not  only  series  6  but  also  series  1  to  5  to  improve  the 
forecasts  of  series  6. 
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Table  1.1  Data  Set  One 


■ 

Series  1; 

Series  2:  Y2 

Series  3;  Yg 

Series  4:  Y^ 

Series  5:  Y^ 

Series  6;  Yg 

1 

yi,t 

3^2, t 

y3,t 

y4,t 

y5,t 

^6,1 

Ml 

0 

0 

0 

0 

0 

0 

1 

0.2 

0.3 

3.9 

0.8 

0.8 

0.5 

2 

3.3 

1.4 

7.2 

3.0 

2.7 

2.0 

3 

8.5 

3.5 

12.1 

5.8 

5.4 

4 

14.5 

6.1 

18.1 

9.8 

10.0 

5 

22.7 

10.2 

26.2 

6 

34.5 

14.7 

36.6 

7 

48.2 

20.9 

49.9 

8 

64.2 

28.5 

64.7 

56.6 

57.0 

9 

81.8 

37.2 

81.6 

72.4 

70.0 

75.6 

10 

101.2 

46.2 

98.6 

89.7 

88.4 

95.0 

11 

123.7 

56.6 

123.2 

111.9 

116.8 

12 

148.0 

68.3 

146.6 

134.4 

131.8 

141.6 

13 

169.4 

81.5 

171.3 

156.4 

157.4 

14 

194.3 

92.8 

181.2 

184.4 

199.4 

15 

217.2 

103.3 

214.5 

199.9 

- - - 

211.5 

222.3 

16 

233.9 

112.0 

232.1 

215.3 

231.0 

225.8 

17 

252.1 

120.7 

248.0 

233.2 

250.8 

260.8 

18 

266.0 

129.0 

260.8 

248.5 

270.2 

276.1 

19 

278.9 

135.9 

273.5 

262.6 

285.1 

293.6 

20 

289.6 

141.6 

284.7 

273.4 

299.8 

305.2 

21 

298.9 

146.5 

293.7 

281.4 

312.0 

314.4 

22 

306.0 

152.6 

300.9 

288.4 

320.7 

322.8 

23 

312.0 

153.6 

307.7 

294.2 

327.9 

330.2 

24 

316.7 

156.0 

298.0 

298.5 

334.4 

337.6 

25 

320.1 

157.6 

317.6 

301.8 

338.9 

341.7 

26 

322.6 

158.7 

319.9 

303.3 

342.1 

345.8 

27 

324.3 

159.4 

320.9 

304.1 

341.9 

346.5 

28 

325.3 

159.9 

321.8 

304.8 

346.5 

348.4 

29 

326.3 

160.4 

322.7 

305.4 

344.9 

350.2 

30 

327.7 

160.5 

323.3 

305.9 

346.3 

351.7 

31 

328.2 

160.7 

323.9 

306.2 

349.3 

353.3 

32 

328.4 

160.8 

324.1 

306.3 

350.6 

354.8 

33 

328.6 

160.9 

324.2 

306.5 

351.0 

356.4 

34 

328.8 

161.0 

324.4 

306.8 

352.1 

35 

328.9 

161.1 

324.5 

307.0 

352.7 

36 

329.0 

161.2 

324.6 

307.0 

353.3 

37 

329.1 

161.2 

324.7 

307.1 

353.3 

38 

329.3 

161.3 

324.7 

307.2 

353.7 

39 

329.0 

161.3 

324.7 

307.3 

352.2 
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Figure  1.1  A  Plot  of  Data  Set  1 
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Table  1.2  Data  Set  Two 


Figure 


2  A  Plot  of  Data  Set  2 


Table  1.3  Data  Set  Three 


Series  1:  Yj^ 

Series  2:  Y2 

Series  3:  Yg 

t 

yi,t 

y2,t 

^3,1 

0 

.862 

.119 

.131 

1 

3.467 

.21 

.266 

2 

6.36 

.291 

.355 

3 

8.902 

.347 

-45 

4 

10.93 

.434 

.543 

5 

12.46 

.525 

.63 

6 

13.78 

:586 

.693 

7 

14.96 

.682 

.752 

g 

16.05 

.738 

.814 

9 

17.15 

.802 

.845 

10 

18.48 

.87 

.915 

11 

19.8 

.937 

.974 

12 

21.21 

.994 

1.098 

13 

22.28 

1.042 

1.162 

14 

23.32 

1.087 

1.196 

15 

24.17 

1.142 

1.196 

16 

25.06 

1.186 

17 

25.76 

1.244 

18 

26.57 

1.285 

19 

27.39 

1.339 

20 

28.27 

1.383 

. 

21 

29.09 

~  L403 

22 

29.92 

1.428 

23 

30.74 

1.55 

24 

31.68 

1.59 

25 

32.53 

1.662 

•  - 

26 

33.31 

1.725 

27 

33.97 

1.725 

28 

34.68 

29 

35.42 

30 

36.13 

31 

36.98 

32 

37.81 

33 

38.76 

34 

39.55 

35 

40.32 

- 4L25 

42.08 

42.7 

42.92 

_ _ _ _ _ _ 
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Figure  1.3  A  Plot  of  Data  Set  3 


In  Section  2  we  overview  the  DLM.  We  propose  the  DLM  with  leading  indicators  in 
Section  3.  Section  4  pertains  to  applications.  In  Section  5  we  briefly  discuss  our  future  work. 
Details  of  the  forecasting  formulae  of  the  DLM  with  leading  indicators  are  in  the  Appendix. 


2.  OVERVIEW  OF  DLM 

DLMs,  also  known  as  Kalman  filter  (KF)  models,  are  models  from  which  a  large  number 
of  useful  forecasting  schemes  can  be  derived  as  special  cases  [cf.  Harrison  and  Stevens  (1971,  1976) 
or  West  and  Harrison  (1989)].  In  what  follows,  first  we  review  the  general  model  and  forecasting 
formulae  of  the  DLM,  then  we  specify  some  particular  KF  models  pertaining  to  processing  our 

data  analysis. 


2.1  General  Form  and  Forecasting  Formulae  of  DLM 


The  DLM  is  often  specified  as 


where 


Yt  =  Kh  +  ^t> 
^  =  Gt  ^t-1  + 


(2.1) 


is  the  parameter  vector  of  the  system  at  time  t  and  it  is  unobservable 
F^  is  the  known  dynamic  regression  vector  at  time  t, 

Gj.  is  the  known  state  evolution  matrix  at  time  t. 


is  the  observation  error  at  time  t, 
is  the  system  error  vector  at  time  t, 

Yj^,  .  .  .  ,  .  .  .  is  the  observed  series. 

The  first  equation  is  called  observaiion  equation  and  the  second  one  is  called  system  equation. 


Kalman  (1960)  has  obtained  the  recursive  equations  and  the  predictive  distributions  for 
the  DLM  of  form  (2.1)  under  the  Gaussian  set-up.  Kalman’s  results  are  summarized  below. 

Let  “X  ~  N(/i,  cr^)”  denote  the  fact  that  X  has  a  Gaussian  distribution  with  mean  p 

j  •  2 

and  variance  <7  . 

If  ~  N(0,  U^),  ~  N(0,  W^),  the  sequences  {uj  and  {wj  are  mutually 

independent,  the  prior  of  0q  (before  observing  any  data  from  the  time  series)  is  N(ii1q,  Cq),  then 

i)  (<>tlyt)  ~  N(mt,q),  (2-2) 

vpliere  y^  is  the  observation  set  (y^,  y^,  ■  ■  ■  ^  Xt);  i-®-  realization  of  ...  ,  Y^, 

™t  ^t  ™t-i  +  *^t  Qt^  (yt "  ^t  ^t  ™t-i)’ 

Ct  =  Rt  -  Rt  n  n  Q‘t^ 

Rt  =  ^t  ^t-i  ^t  + 

Qt  =  + 

ii)  (Yt+k  I  yt)  ~  N(f^^j^,  <r2^k)’  •  (2-3) 

where  f^^j^  =  •••  ,  and 

"^t-fk  =  ®’t+k  ^t-fk  ^t-l-k-1  ■■■  ^t-bl  ^t  ^t+1  ■■■  ^t+k-1  ®Uk  ®’t-fk 

+  n+k(  E  (Gt+k''-Gt+i+l)Wl+i(Gt+k-''°t+i+l)'  +  Wt+k)ft+k 

+  "t+k- 

Smith  and  West  (1983)  have  studied  the  case  wherein  and  are  not  fully  specified, 
and  their  results  are  given  below. 

If  (uj  I  U)  ~  N(0,  U),  and  the  prior  of  U  is  an  inverted  gamma  with  shape  parameter 
no/2  and  scale  parameter  do/2,  (w^  |  U)  ~  N(0,  UW*),  (<?o  I  U)  ~  N(mo,  UC^),  with  W*  and 
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Cq  specified,  and  if  given  U  the  sequences  {u^}  and  {wj  are  assumed  mutually  independent,  then 


(^t  i  yt)  ~  Tu^(“t,  q) , 


(2.4) 


where  (m^,  q)  denotes  the  multivariate  student-t  distribution  with  n^.  degrees  of  freedom, 
t 

mode  and  scale  matrix  C^,  with 

c,  =  (Rt  -  R,  F,  n  m/Q,), 


»t  =  (Gt  cr.i  g;  +  wp, 

Qt  = 

^t  =  °t-l  + 

■J,-!  +  (n  -  K  Gi  . 


In  this  case,  the  k-step  ahead  predictive  distribution  is  also  a  univariate  Student-t  distribution 

2 

with  n^  degrees  of  freedom,  mode  and  scale  where 

^t+k  =  ^t+k  (^t+k  ^t-fk-1  ®t-|-l)  ’ 


“^t+k  =  ®’t-l-k  ^t-t-k  ‘^t-l-k-hl  ■■■  ^t+l)  ^t  ^t+k  ■■■  ^Uk-l  ^t+k)  ®'t-hk 

+  i  (1  +  n+k  (K+k  +  .SlG.+k  -  Gt+i+l)  wl+i(Gi+i+r-  ‘^l+k))  F,+k). 

^  1=1 

for  k=l,  2,  .  .  .  .  (2-5) 
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Hence,  a  general  application  of  DLM  to  a  practical  forecasting  problem  consists  of  two 
tasks:  i)  a  specification  of  a  particular  form  of  (2.1),  and  ii)  a  specification  of  the  distributions  of 
the  errors  and  the  prior  of  to  set  the  forecasting  conditions  in  one  of  the  preceding  two 

schemes. 


2.2  Growth  Models 

Because  of  the  trend  feature  in  all  the  three  data  sets,  we  will  concentrate  on  the 
specification  of  growth  models. 

Growth  models  are  a  class  of  special  DLMs.  A  growth  model  can  be  described  by  two 
parameters  6^  and  (3^  at  time  t.  The  former  is  often  called  “lever  and  the  latter  called  “change 
of  level”  or  “slope.”  In  terms  of  model  (2.1),  the  growth  model  is  defined  as 


p  -] 

- 

p 

^t 

.  Ft  = 

1 

>  ’'t  = 

''t 

and  = 

/t_ 

0 

^t_ 

L 

1  1 

0  kt 


Alternatively,  it  can  be  written  as 

’'^t  =  ^t  +  ’^t’ 

I  ^t  =  ^t-1  +  ^t-1  +  n-  (2.6) 

^t  =  ‘‘t^t-1  +  ^t  • 

Specifically,  we  use  the  following  three  growth  models  to  analyze  our  data  sets. 

1)  Linear  growth  model 

This  is  the  simplest  case  of  growth  models.  Here,  is  always  specified  as  1.  This 
model  has  been  found  suitable  for  dealing  with  data  having  a  linear  upward  trend,  for 
instance  y2^  in  data  set  3. 
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2)  Segmented  linear  growth  model 

Examine  the  plots  of  data  set  2  (Figure  1.2).  All  the  three  series  show  an  upward 
trend,  but  the  trend  changes  at  its  slope  about  t=13.  Therefore,  is  specified  as 

,1,  if  t  ^  13, 

Kt  = 

^  0.9,  if  t  =  13. 

In  general,  if  the  change  point  of  the  trend  is  at  t^,  the  specification  of  is  of  the 
form 

,1,  ift  #  tQ, 

=  I 

1.  Positive  constant  (  ^  1)  ,  at  t— tQ. 

3)  S-skaped  growth  model 

This  model  is  suitable  for  data  set  1;  such  data  shows  a  trend  in  three  stages;  at 
first,  for  t  <  12,  the  growth  rate  appears  increasing,  then  it  appears  to  be  constant, 
and  finally,  for  t  >  16,  it  decrease  and  tends  to  zero.  In  effect,  the  trend  is  an  S- 
shaped  one.  Thus  for  data  set  1,  is  specified  as  follows: 


,  1.15, 

if  t  <  12, 

Kt  = 

ifl3  <  t  <  15, 

^  0.85, 

if  t  >  16. 

The  specification  of  for  a  general  ’S’  -  shaped  trend  is 
Cj^  (constant  >  1),  if  t  <  tj^, 

=  I  1  ,  if  tj  <  t  <  t2, 

C2  (constant  G  (0,  1)),  if  t  >  t2, 
where  t|^,  t2  are  terminals  of  stages  1  and  2. 


12 


3.  DLM  WITH  LEADING  INDICATORS 


Now  we  start  our  expansion  of  the  DLM.  Before  doing  so,  we  need  to  introduce  a  more 
elaborate  notation.  Let 


£,t 


'^£,t 


denote  an  observation  on  the  £-th  series  at  time  t, 
is  a  state  parameter,  standing  for  the  level  of  the  £-th  series  at  time  t, 
is  the  other  state  parameter,  reflecting  the  change  of  the  level  of  the 
£-th  series  at  time  t, 

is  the  observation  error  of  the  £-th  series  at  time  t, 
and  W£  are  the  system  errors  of  the  £-th  series  at  time  t,  corresponding 
to  parameter  9^  ^  and  l3^,  respectively. 


3.1  The  Forms  of  DLM  with  Leading  Indicators 

Without  loss  of  generality,  let  {Y2  J  be  the  series  of  interest  and  {Y^  J  be  the  leading 
indicator  series.  Assuming  a  growth  model,  we  introduce  a  weight  7  to  incorporate  the  effect  of 
the  indicator  series  in  the  series  of  interest.  The  following  two  forms  can  be  considered. 


1)  Weighted  on  level,  6.,  t 

For  the  leading  indicator  series,  we  have,  as  before 

'^l,t  =  ^l,t  +  '^l,t’ 

I  ^l,t  =  ^l,t-l  +  ^l,t-l  +  '^Tt  > 
^l,t  “  *^t^l,t-l  +  ^l,t  ’ 
and  for  the  series  of  interest,  we  have 

I  '^2,t  -  ^2,t  +  ’^2,t’ 

^  h,t  =  T'^2,t-1  +  ^l,t  +  ''2,f 

2)  Weighted  on  slope  0.,  t 


c  Yi,t  =  ^l,t  + 

I  ^l,t  =  ^l,t-l  +  ^l,t-l  +^l,t’ 
^l,t  =  *^t  ^l,t-l  +  ^l,t  ! 


(3.1a) 


(3.1b) 
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(3.2a) 


(3.2b) 


^2,t  -  ^2,t  “2,t’ 

h,t  =  h,t-i  +  ^2,t-i  +  ''2,t  ’ 

^2,t  =  ^2,t-l  +  ^l,t  +  ^2,t  • 


As  said  before,  for  Data  Sets  One,  Two  and  Three,  the  linear  growth  model,  the 
segmented  linear  growth  model  and  the  S-shaped  growth  model  are  adopted  respectively.  For  all 
three  data  sets,  the  second  form  performs  better  than  the  first  one. 


The  assignment  of  weight  y  is  subjective;  it  is  based  on  the  forecaster’s  belief  in  the 
chosen  model  to  describe  the  series  of  interest,  and  the  potential  benefit  from  the  use  of 
information  from  the  indicator  series.  For  example,  if  7:=!,  does  not  play  any  role  and  (3.1a) 
is  reduced  to  a  steady  model,  whereas  (3.2a)  is  reduced  to  a  conventional  growth  model. 


In  general,  if  we  partition  the  parameter  vector  0  ^  as  0 

,(2) 


with  being  the 


state  parameters  specific  to  the  series  of  interest  and  0^^^  being  those  state  parameters  containing 
“pattern  information”  common  for  all  series.  Then  the  general  expression  of  the  DLM  is  of  the 

form 


(3.3) 


where 


®£,t  - 


®'t^£,t  +  "£,t 

®£,t  V  +  ■*£,t®£-l,t  + 

■  g(") 

g(‘^) 

0  0 

gP* 

r,G<22) 

’  ^£,t  = 

0  (i-rg) 

14 


partitioned  corresponding  to 


'  g(*»  g(‘2) 

Gt  = 

gP‘)  g(“> 


Fg  is  a  diagonal  matrix  with  entries  taking  values  between  0  and  1,  when  £—1,  Fj^  —  L 

3.1.1  Relationship  to  a  2-Dimensional  KF  Model 

A  two-dimension  KF  model  is  often  defined  as 


^£,t  =  *’t^£,t  "£,t’ 

=  ®£,t  ^£,t-l  +  ''^£,t  ^£-l,t  +  *^£,t®£-l,t-l  + 


(3.4) 


[cf  Habibi  (1972),  Woods  and  Radewan  (1977),  Woods  and  Ingle  (1981),  Katayama  and  Kosaka 
(1979),  etc.].  In  this  sense  (3.3)  can  be  regarded  as  a  special  case  of  (3.4)  with  Kg  ^  =  0.  From 
now  on,  we  call  this  expansion  form  of  the  DLM  as  the  DLM  with  leading  indicators. 
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3.2  Inference  and  Forecasting  Formulae 

Let  us  consider  a  simple  example  of  the  DLM  with  leading  indicators  to  demonstrate  our 
method  by  which  we  solve  the  inference  and  forecasting  problem  of  the  DLM  with  leading 
indicators.  Then,  we  write  down  the  general  inference  and  forecasting  formulae. 


3.2.1  An  Example  of  the  DLM  with  Leading  Indicators 


Suppose  that  observations  yj^  ^  y^  2’  ^2,1’  ^2,2  available  and  predictions  Y2  3  and 
Y9  A  are  requested.  Assume  the  suitable  model  is  (3.2)  and  the  priors  for  q  and  g  are 
(01o|U)  ~  g),  I  U)  ~  N(bj^g,  Utr^^g),  (u.,t  |  U)  ~  N(0,  U),  (v.,  1 1  U)  ~ 

’  ’  ’  ’  Ug 

N(0,  UV),  (w.,t  1  U)  ~  N(0,  U\V),  the  prior  of  U  is  an  inverted  gamma  with  parameters  and 
We  also  assume  the  same  independence  conditions  as  we  deal  with  the  DLM  [cf.  West  and 
Harrison  (1989)].  Besides,  we  assume  that  ^2,0  =  ^1,0  +  ®1'  ^2,0  ~  ''^1,0  +  ®2  ®2 

known  constants.  Under  these  assumptions  follow  from  (3.2a) 

^1,0  =  > 

'1,0  ^  ^1,0  n,l  ’  ^1,1  ^1^1,0  +  ^1,1  ’ 

^1,2  =  ^1,0  +  (l+kl)/?l,0  +  '^l,!  +  '"I,!  +  ^'1,2  ’ 

^1,2  =  ^2^1^1,0  +  ’"2'^1,1  +  "^1,2  ’ 


^1,0  -  ^1,0  ’ 

^1,1  =  ^1,0  +  ^1,0  +  '"1,1 


^1,4  =  ^1,0  +  (l+ki(l+Ml+‘^3)))^l,0  +  ^1,1  +  +  ^1,2 

+  (l+k3)w^  2  +  ^^1,3+  ^^1,3  +  '^1,4  ’ 

^1,4  =  ‘‘A  ••^1^1,0  +  ^4^3*'2'^1,1  +  ^4*'3'^1,2  +  ^4^1,3  +  '^1,4  ’ 

’'^1,1  =  ^1,0  +  ^1,0  +  ''1,1  +  "1,1’ 

Yi,2  =  ^1,0  +  (l+h)^l,0  +  '^1,1  +  '^l.l  +  ^1,2  • 
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Alternatively,  it  can  be  represented  in  the  matrix  form  (6^,  Yj^  5)^  -  L  Z  , 

where  0^  =  q  ^1,0  ^1,1  ^1,1  ^1,2  ^1,2  ^1,3  ^1,3  ^1,4  ^1,4)  ’ 

1 

0  1 

1  1  1 

0  kjL  ®  ^ 


1 

1+kj^ 

1 

1 

1 

0 

k2ki 

0 

k2S 

0 

1 

1 

1+kj^+k  j^k2 

1 

1+^2 

1 

1 

1 

0 

0 

^3^2 

0 

^^3 

0 

1 

1 

1+k  j^(l+k2(l+k2)) 

1 

1 

l+k3 

1 

1 

1 

0 

k4k3k2ki 

0 

k4k3k2 

0 

^4^3 

0 

^^4 

0 

1 

1 

1 

1 

0 

0 

0 

0 

0 

0 

0  1 

1 

1+k 

1 

1 

1 

0 

0 

0 

0 

0  0 

Z  =  [^1,0  ^1,0  ^^1,1  '^1,2  '^1,2  n,3  ^^1,3  '^1,4  ^1,4  '^l,!  ^1,2  1'  ' 

Assume  that  (Z  |  U)  ~  N(/i,  UEg)  ,  U  ~  IG(  ^  )•  Then,  by  the  properties  of  the  multivariate 
normal  distribution,  we  can  obtain 

(^1,0’  ^1,0’  >^1,4’  ^1,4  I  u,  yi,i,  yi,2)  ~  N(Mp  UE^), 


(1) 


(^1,0’  ^1,0’  ’  ^1,4’  h,A  I  yi,V  yi,2)  ~  %+2(Mi’  5^  ^1)’ 


(U  I  yi^p  yi^2) 


IG( 


no+2 

2 


), 
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where  Mp  Ep  can  be  calculated  out  (for  brevity,  we  omit  the  formulae  for  calculating 

El,  d^^^)- 

Similarly,  (3.2b)  offers  a  tool  to  obtain  the  relationship  between  (^2,0’  ^2,0>  ’  ^2,4’ 

^2,4’  ^2,1’  ^2,2’  ^2,3’  ^^2,4)  ^^1,0’  ^1,0’  ’  ^1,4’  ^1,4’  '"2,1’  '"2,1’  ’  ^"2,4’  "2,4’  '^2,1’ 

•••  ,  U2  4),  and  we  can  get  the  predictive  distribution  (Y2  3,  Y2^4  |  yi  1,  yi  21  y2,l’  ^2,2^ 
the  leading  indicator  series  {Yj^  is  incorfKjrated. 


3.2.2  General  Formulae 


Let  n  be  the  forecast  horizon; 

let  yP  =  [Yg^i,  •••  ,  and  y^  =  y^^^  =  [y^  p  be  a  realization  of 

Yp^  =  lX£,t+i’  ■■■  ’ 


(1) 


Y«,n  = 


Y^l) 

Yf) 


/<n 

\ 

ti 

•  ’  %tY'  n 

-  K,t+i’" 

•  ’  ^^,nY'  "£,n  - 

let 


Qf  =  [^£,0’  •••  ’  V’  ^ 

Let  y£  ^  denote  all  prior  information  (including  the  data)  before  observing  any  data  from 
series  Yg. 

For  model  (3.3)  consider  the  two  scenarios  described  below. 

Scenario  A:  Let  (^  |  yg)  ~  N(/i,  E),  ~  ^(0,  U^  j^)  sequences  {u^  J,  {w^  J  are 

independent,  /x,  S,  are  known;  assume  that  after  filtering  £-1  series, 


18 


£=2,  3,  ...  ,  (e^.i  I  y^.i)  ~  N(mg_j,  has  been  obtained  and  that  ~ 

U£,J’  ^£,n  ~  ^£,n)’  sequences  {u^  J,  {wg  J  and  I  ^£-1^ 

mutually  independent,  (6£  q  |y£.i)  =  (®£-l,0  ^  ?£+l^  ®£,0  ®£,0  ^£,n 

and  Wg  are  also  known. 

Scenario  B:  Let  (^lyQ,  U)  ~  N(/x,  UE),  (uj^n  I  U)  ~  N(0,  UU^  J,  given  U  sequences  {u^  J, 
{w^  J  are  independent;  fi,  E,  Uj  jj  are  known,  U  is  unknown  but  (U  |  yg)  ~ 
IG^ .  Assume  that  after  filtering  £-1  series,  £=2,  3,  ...  ,  (0£.i  I  y^.X)  U) 
~N(m^.p  UC^.^)  and  (U  !  y^.j)  ~  IG(^  ,  -|^)  have  been  obtained;  we  also 

assume  that  (ug  |  U)  ~  N(0,  |  U)  ~  N{0,  J,  given  U, 

sequences  {u^  J,  {wg  J  and  {^g_j  ^  1  yg.^}  are  mutually  independent,  Ug  Wg 

are  known,  (tfg  q  |  yg.x>  •)  =  (^£-1,0  I  ?£-!’  "*■  ®£,0  ®£,0 

We  have  the  following  formulae  for  inference  and  forecasting. 

1)  For  Scenario  A 

The  inference  and  forecasting  formulae  of  series  1  are 


01 

^^lyi.i 

^^1^1.2 

yJI) 

yo 

~  N 

0 

h-* 

1 

^yi.i^i 

^yi.i 

^yi.i2 

¥^2) 

m„ 

yi.2 

^yi.2^1 

^yi.2i 

^yi.2 

. 

. 

. 

- 

- 

(  111 

where  =  L  p  ,  I  myl’^  1  = 
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ii) 


where 


^yi.i  ^ 


Ca  —  L  E  Ii  ,  I  ^  ^ 

*1  V‘’>'1.21  ^1.2 


1-12  )=  F'C„  F  +  Ui  „, 
'1.2  /  ^ 


^yi.1^1 


"y  1.2^1 


=  C.  F, 


L  = 


I 

Gi  I 

G2G1  G2  I 

•  •  •  • 

«  •  •  • 

Gq-'-Gj  Gn  "^2  •••^3 


(3.6) 


*yi.2  "  “yi.2  ^yi.2i  ^^yi.i^’^  -  “yi.i)’ 
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where 


i) 


where 


/  ^^1  %yi.2\ 

[  %.2h  ^^1.2  j 


Siyi^yi.2  j"  (^^1.21  j  S.i(^yi.i^i  ^^1.12) 


ii)  specifically,  the  k-step  ahead  predictive  distribution  is 


(■^i,t+k  I  ?0'  ?i.t)  ~  '‘(*t+k'  Vk,  t+k)  '■=' . 


(3.7) 


™t+k  component  of  niy^ 


Ct-i-ii  t+k  diagonal  entry  of  Cy^ 


Recursively,  for  series  £,  £=2,  3,  ...  ,  we  have 


®£ 

in /I 

^^£^£.1 

^^£^£.2 

y£-i 

~N 

mv 

y£.i 

^y£.i^£ 

^y£.i 

^y£.12 

vf) 

niv 

y£,2 

^y£.2^£ 

^y£.2i 

^y£.2 

. 

. 

. 

. 

- 

- 

(3.8) 
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/S.1  S.12\ 

V  ^y£.21  ^n.2  I 


^  +  U£,n 


I 


®£,1 

**£,1 

®£,2  ®£,1 

®£,2^£,1 

^£,2 

®£,n  "^£,1 

®£,  n'"®£,2^£,l 

^£,n” 

®£,3*^£,2 


F  is  specified  as  the  same  as  in  (3.5), 


®£,1 

®£,2 

®£,1 

®£,n 

•H, 

®£,0 


^£,1 

I 

®£,2  ®£,1 

®£,2 

I 

. 

®£,n"°£,l 

^£,  n  "®£,2 

H£,n  -H 

£,3  ■■■ 

®£ 

)  ^((  ^ 

(% 

^^£^£.2 

1  ?£-!’  y£,t 

^y£.2 

where 


(3.9) 
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iii)  the  k-step  ahead  predictive  distribution  is 

~  t^K+k  • ‘t+k,  t+k)  ‘='’2 . n-t 

where  is  the  k-th  component  of  my^  ^  , 

^t+k,  t+k  diagonal  entry  of  Cy^  ^  . 


2)  For  Scenario  B 

The  inference  and  forecasting  formuW  of  series  1  are 


(3.11a) 


23 


(3.11b) 


^1 

Ulig 

^^lyi.i 

^^iyi.2 

yo 

~S,0 

“yi.i 

’  “1,0 

‘^yi.i^i 

^yi.i 

^yi.i2 

yJ2) 

“yi.2 

^yi.2^1 

^yi.2i 

^yi.2 

. 

. 

. 

- 

- 

where  all  submatrices  are  specified  as  the  same  as  in  (3.5); 


(3.12a) 

(3.12b) 


where  nj^^^  —  n^^  q  +  t,  dj^  q  +  dj^^^  , 

‘I'l.t  =  (yi,t  -  ”^71.1^'  (^71.1^*^  "  “yi.P 

all  submatrices  are  specified  as  the  same  as  in  (3.6); 

iii)  specifically,  the  k=step  ahead  predictive  distribution  is 

(Yl,t+k  I  yO’  ~  5^  ^t+k,  t+k) 


,  for  k=l,  ...  ,  n-t,  (3.13) 


where  m[^j^  is  the  k-th  component  of  m. 


yi.2  ’ 
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t+k 


is  the  k-th  diagonal  entry  of  Cy^  ^ 


Recursively,  for  series  £,  1=2,  3,  ...  ,  we  have 


1 - 

6 

^4 

i) 

y|i) 

~N 

y«.i 

,  U 

^yiA^i 

S.1 

^y£.i2 

m„ 

ye.2 

^^t.2^i 

^yf.2i 

^y£.2 

. 

. 

. 

- 

- 

® 

^^£^£.1 

*^V£.2 

y('> 

U-1 

~  T 

“£,0 

“y£.l 

^^£,0 
’  ^^£,0 

^y£.l^£ 

^^£.1 

^y£.12 

Yf> 

“y£.2 

^^L2h 

S.21 

^^£.2 

. 

. 

. 

- 

where  all  submatrices  are  specified  as  the  same  as  in  (3.8); 


(3.14a) 


,  (3.14b) 


(3.15a) 


(3.15b) 


(3.15c) 
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^'e,t  =  (y£,t  -  “y£.i)'  "  “y^.i) 


all  submatrices  are  specified  as  the  same  as  in  (3.9); 


iii)  the  k=step  ahead  predictive  distribution  is 


(Ye,t+kl?(-l.^')  ~  Sri”‘+'‘'  ^  to' ‘=1' 2,  ...  ,  n-t. 


(3.16) 


where  are  specified  as  the  same  as  in  (3.10). 

It  can  be  shown  that  equations  (2.2)  -  (2.5)  are  merely  the  marginal  distribution  of  (3.6) 
and  (3.12c)  respectively.  Since  the  DLM  with  leading  indicators  deals  with  the  senes  of  interest 
in  conjunction  with  indicator  series,  any  assumption  on  the  independence  of  ^  ^  and  0^  is 
irrelevant.  The  only  way  to  treat  the  correlations  among  all  state  parameters,  is  to  represent  the 
probabilistic  structure  of  the  DLM  or  the  DLM  with  leading  indicators,  and  the  mechanism  of  the 
filtering  procedure,  in  terms  of  the  joint  distribution  of  the  state  parameter  space. 


4.  APPLICATIONS 

We  apply  our  approach  to  the  data  given  in  Section  1. 

If  the  sequence  [y^  y2,  ...  ,  yt-  Yt+P  -  -  yml  i®  observed  from  the  time  series  of  interest 
and  we  were  to  use  the  first  t  observations  to  predict  the  next  m-t  values  ,  then  we  specify  the 
cumulative  square  error  (CSE)  as 

m-t  „ 

CSE(m,t)=  £  (yt+k  -  ®(Yt+k  I  yt))  - 
k=l 

where  (Yt^.jj|  yt)  is  the  k-step  ahead  prediction  based  on  observations  y^^.  We  use  CSE  to  measure 
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the  forecasting  performance  of  our  approach.  The  smaller  the  CSE(m,  t)  is,  the  better  the 
forecasts  will  be  since  CSE(m,  t)  reflects  the  total  loss  of  the  (m-t)  forecasts  when  the  loss 
function  is  a  quadratic  function. 

We  select  an  S-shaped  growth  model,  a  segmented  linear  growth  model  and  a  linear 
growth  model  to  analyze  Data  Sets  One,  Two  and  Three  respectively.  We  set  the  conditions  for 
data  analysis  in  the  scheme  described  as  scenario  B.  Specifically,  for  the  DLM,  we  specify  the 
initial  conditions  as 

the  prior  distribution  of  U  is  an  IG  (2.5,  1),  i.e.  nQ  =  5,  dQ  =  2; 

(vJU)  ~  N(0,  O.OlU);  (wt|U)  ~  N(0,  0.2  U); 

(^0 1  yo'  ~  u)’  (^0 1  yo’  ~  ^(yi  ~  u)! 

Yq  is  assumed  available;  (^q  |  yQ)  U)  is  independent  of  (/?q  |  yg,  U). 

Analogous  to  the  above  specification,  the  initial  conditions  for  the  DLM  with  leading 
indicators  are 


for  £=2,  3,  ... 


with  Z)  Q  = 


E 


^£-1,0“  I  ?’£-l’  ’ 


0.01 

0 


Vl))’  (Ulyi^o)  ~  1); 


(V£  J  u)  ~  N(0,  O.OlU);  (w^^^  |  U)  ~  N(0,  0.2U). 

Part  of  our  analysis  results  are  listed  in  Tables  4.1  -  4.4.  These  results  show  that  the  use 
of  DLM  with  leading  indicator  can  improve  forecasting  significantly,  incorporation  of  two  or  more 
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indicator  series  may  not  be  more  effective  than  incorporation  of  one  indicator  series  (cf.  Table 
4.2).  Table  4.4  offers  an  example  to  assign  the  value  of  7  intuitively.  From  Figure  1.3  the  data 
plot  of  series  Y3  looks  quite  similar  to  that  of  series  Y^.  So  a  small  7  (namely,  7  =  0.05)  leads  to 
much  better  forecasts  than  a  bigger  one  (7  =  0.975  here).  It  also  gives  us  an  idea  of  how  the 
variances  of  the  predictions  will  be  if  the  assignment  of  dg  is  not  appropriate.  In  this  case  dg  =  2 
>  d't  =  0.005684  (when  7  =  0.975),  E{Y^q\  y^o)  =  2.4977  ,  V(Y4o|yio)  =  63.0757  .  If  we 
shrink  dg  from  2  to  0.05,  the  above  variance  will  reduce  to  its  1/40  of  the  current  values  and  the 

mean  remains  unchanged. 
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Table  4.1  A  Comparison  of  Forecasts  of  Yg  of  Data  Set  One  Series 

from  the  Growth  Model  and  from  the  2-d  Model  (7  =  .05) 


t 

Forecasts  from  S-shaped  Growth  Model 

Forecasts  from  the  DLM  with  leading 

indicators  (Indicator  series:  Yj^) 

Observation 

mean 

variance 

mean 

variance 

21 

293.7 

292.51 

11.65 

293.98 

5.25 

22 

300.9 

299.71 

18.77 

301.44 

6.27 

23 

307.7 

305.83 

29.40 

307.45 

7.19 

24 

298.0 

311.04 

43.59 

312.15 

8.02 

25 

317.6 

315.46 

61.19 

315.70 

8.78 

26 

319.9 

319.22 

81.99 

318.30 

9.51 

27 

320.9 

322.42 

105.72 

320.16 

10.21 

28 

321.8 

325.13 

132.09 

321.51 

10.92 

29 

322.7 

327.44 

160.80 

322.54 

11.62 

30 

323.3 

329.41 

191.59 

323.34 

12.32 

31 

323.9 

331.07 

224.21 

323.91 

13.03 

32 

324.1 

332.49 

258.42 

324.29 

13.74 

33 

324.2 

333.70 

294.02 

324.53 

14.45 

34 

324.4 

334.72 

330.80 

324.7 

15.17 

35 

324.5 

335.59 

368.62 

324.82 

15.88 

36 

324.6 

336.96 

407.32 

324.92 

16.59 

37 

324.7 

337.50 

446.79 

325.02 

17.31 

38 

324.7 

337.95 

486.91 

325.11 

18.16 

39 

324.7 

338.34 

527.59 

325.18 

19.60 

CSE 

1313.48 

208.408 

^20 

111.567 

39.006 

29 


Table  4.2  A  Comparison  of  Forecasts  of  Yg  of  Data  Set  One  from 

the  Growth  Model  and  from  the  2-d  Model  (with  7=.05) 


Forecasts  from  S-shaped 
Growth  model 

Forecasts  from  the  DLM  with  leading  indicators 

Indicator  series:  Yg 

Indicator  series:  V 

'4  ^5 

t 

Observation 

mean 

variance 

mean 

variance 

mean 

variance 

21 

314.4 

316.13 

38.80 

317.96 

11.95 

317.62 

14.84 

22 

322.8 

325.57 

62.49 

327.67 

14.31 

327.11 

17.61 

23 

330.2 

333.60 

97.87 

335.46 

16.47 

334.76 

20.02 

24 

337.6 

340.43 

145.12 

341.55 

18.42 

340.85 

22.20 

25 

341.7 

346.23 

203.73 

346.08 

20.20 

345.39 

24.27 

26 

345.8 

351.17 

272.99 

349.27 

21.89 

348.52 

26.29 

27 

346.5 

355.35 

351.98 

351.47 

23.54 

350.55 

28.30 

28 

348.4 

358.91 

439.79 

353.14 

25.17 

352.30 

30.31 

29 

350.2 

361.94 

535.40 

354.39 

26.81 

353.42 

32.33 

30 

351.7 

364.51 

637.91 

355.63 

28.45 

354.65 

34.34 

31 

353.3 

366.70 

746.51 

359.97 

30.10 

356.08 

36.35 

32 

354.8 

368.56 

860.41 

358.22 

31.76 

357.32 

38.36 

33 

356.4 

370.15 

978.94 

359.28 

33.42 

358.28 

40.37 

CSE 

1313.48 

224.58 

149.56 

*^20 

376.121 

319.94 

264.66 
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Table  4.3  A  Comparison  of  Forecasts  of  Yn  of  Data  Set  Two  from  the 
Growth  Model  and  from  the  2-d  Model  (7  =  .975) 


1 

Forecasts  from  the  Segmented 

Linear  Growth  Model 

Forecasts  from  the  DLM  with  leading  indicators 
(Indicator  series:  Y2) 

Observation 

mean 

variance 

mean 

variance 

11 

81.7 

82.49 

7.49 

82.75 

6.72 

12 

86.5 

87.15 

13.50 

87.58 

11.87 

13 

89.01 

91.34 

22.65 

92.42 

20.48 

14 

91.87 

95.53 

36.50 

97.24 

33.32 

15 

94.27 

99.72 

56.20 

102.03 

51.08 

16 

96.71 

103.91 

82.88 

106.80 

74.41 

17 

99.45 

108.10 

117.68 

111.53 

103.90 

18 

101.8 

112.29 

161.75 

116.25 

140.10 

19 

104.2 

116.48 

216.22 

120.94 

183.49 

CSE 

437.366 

839.528 

‘^10 

35.024 

45.546 
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Table  4.4  A  Comparison  of  Forecasts  of  Yg  of  Data  Set  Three 
from  the  Growth  Model  and  from  the  2-d  Model 


Forecasts  from  the  linear 
Growth  Model 

Forecasts  from  the  DLM  with  leaiding  indicators 
(Indicator  series:  Y2) 

7 

=  .975 

7  = 

=  .05 

Observation 

mean 

variance 

mean 

variance 

mean 

variance 

.974 

.9677 

.4059 

.9686 

.1299 

.9875 

.0880 

12 

1.098 

1.0210 

.7314 

1.0224 

.2295 

1.0462 

.1051 

13 

1.162 

1.0742 

1.2883 

1.0762 

.3961 

1.1009 

.1210 

14 

1.196 

1.1274 

2.13821 

1.1300 

.6443 

1.1527 

.1353 

15 

1.196 

1.1807 

3.3428 

1.1837 

.9877 

1.2027 

.1484 

CSE 

.019 

.018 

.009 

d'lO 

.005507 

.005684 

.002693 
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5.  FUTURE  WORX 


Our  contribution  in  this  effort  on  developing  improved  forecasting  methods  is  the 
expansion  of  the  DLM  such  that  it  can  incorporate  indicator  series  to  improve  forecasting.  And 
because  we  have  not  added  any  additional  restriction  on  the  2-d  model,  our  methodology  can 
work  for  general  two-dimensional  dynamic  linear  models  provided  they  can  be  specified  as 
sequential  models  of  parametric  structure.  Thus,  our  approach  has  a  wide  field  of  applications, 
for  instances,  the  two  dimensional  filter  problems  in  image  processing,  and  some  estimation 
problems  related  to  Markov  random  fields. 

Despite  the  results  that  we  have  had  so  far,  we  need  to  do  further  work  to  more 
generalize  our  achievements.  Namely, 

1)  Weight  7  can  be  specified  as  a  distribution  if  the  forecaster  is  not  sure  to  specify  7  at  a  fixed 
value.  This  specification  will  make  the  use  of  the  DLM  with  leading  indicators  much  more 
difficult  and  complicated.  However,  we  believe,  with  the  help  of  some  simulation 
techniques,  say,  Gibbs  sampling,  we  can  solve  the  forecasting  problem  of  the  DLM  with 
leading  indicators  with  weight  7  specified  as  a  distribution. 

2)  Explore  new  approaches  to  reduce  the  variances  of  the  forecasts.  From  (3.12)  and  (3.15),  we 
can  see  that  the  posterior  mean  of  U  -  a  main  factor  affecting  the  variances  of  the  forecasts  - 
is  determined  by  the  specification  of  the  used  DLM.  So,  another  direction  of  our  future 
work  is  to  study  new  model  monitoring  techniques  to  reduce  the  variances  of  the  forecasts. 
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APPENDIX 


Derivation  of  Predictive  Distributions 

We  derive  here  the  inference  and  forecasting  formulae  given  in  Section  3,  via  some 
elementary  distribution  theory.  Specifically,  we  need  to  apply  the  following  well-known 
propositions  pertaining  to  the  properties  of  the  multivariate  normal  distribution. 

Proposition  I  IfX  ~  N(/i,  E),  then  CX  ~  N(C/i,  CSC'). 

Proposxtion  2  (  xj  )  ~  ^  ((^4)  ’  (  ^2)  )  ’ 

i)  Xj  ~  N(/i^  ,  I^j),  i=I>  2; 

ii)  (X^  1  X2)  ~  N(//i  -I-  Si2S^2  (^2"^)’  ^11  ~  ^12^2^1)  ’  ^2 

nonsingular. 

Proposition  3  If  X  is  a  p-vector  and  (X  ]  ^)  ~  N(/i,  <j>  ^  E), 

^  ^  G(— ,  — )  i.c.  is  a  gamma  random  variable  with  shape  {parameter 

2  2 

and  scale  parameter  then 

i)  {<i>  1  X=x)  ~  G(^^,  with  n*  =  n-|-p  and  d*  =  d-h(x-/i)'E'^(x  -/i); 


ii)  X  ~  Tq  (/i,  2  E). 
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tssica 


Al.  Derive  the  inference  and  forecasting  formulae  of 


Recall  the  model  form  for  series  1 


fyi,t  =  ^t^l,t  +  ’'l,t 


^l,t  =  *^t  ^l,t-l  +  ’'l.f 


(A.1) 


From  the  second  equation  follows 


^l,t  =  •••  0  +  Gt  •••  G2  Wj  1  +  Gt  Gg  3  +  ■••  +  ^ 

=  [Gf  -  Gp  Gt  •••  G2,  0,  •••  ,  0]  for  t=l,  2,  ...  ,  n,  and 

Q  =  [I,  0,  ...  ,  0] 


where  ^  q  -  '"l.J'- 


Thus,  0^  =  Q  e'l  i  ...  =  L  ^  with 


L  = 


I 

Gi 

G2G1 


I 

G2  I 


Gn  "  Gj 


Gt,--'  G<i 


Gn  •Gg  .  I 


And  from  the  first  equation  of  (A.l)  follows 


for  t=l,  ...  n  . 
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Therefore  Yi,n  =  ^'01  +  =  F'L  ^  „  with 


F'  = 


n 

0  F'2 

0  F^ 


0  f; 


Under  scenario  A,  i.e.,  (.^  1  y)  ~  N(/i,  E),  ~  N(0,  J,  and  {u^  J  {w^  J  are  independent 

sequences,  applying  proposition  1  yields 


01 

^^1^1.1 

‘^‘’1^1.2 

yJi) 

yo 

~  N 

“yi.i 

) 

^yi.i 

‘^1.12 

Yp) 

“yi.2 

^yi.ih 

^yi.2i 

‘'yi.2 

_ 

. 

- 

- 

- 

“ 

where 


-  L  /i,  Wi.i 

^1.1  ^^1.12  1 


S.2>'  =  '"''lyi.i  = 

=  LEL'.  LEL'F 

=  F'LEL'F  +  U^j^. 
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The  above  one  is  the  prior  joint  distribution  of  and  Yi,n-  Then,  applying  proposition  2  to  the 
joint  distribution,  we  obtain  the  conditional  distribution  of  0j^  and  given  observations 

=  yi,t  =  “ 


where 


*yL2  "  “yi.2  ^yi.2i^^yi.i^^^-i-t"“yi.i^’ 


/  ^^1^1.2 
(  Si.2^1  ^yi.2 


(^h  ^hH.2^ 
=  i  ^yi.2^i^yi.2 , 


-  c. 


"^lyi.Y 

'yi.2i 


Sl.i»i  ‘^>'1.12 


)■ 


In  particular,  the  joint  predictive  distribution  of  Y^^^  given  observations  ^  is  a  multivariate 
normal  specified  by 


Under  scenario  B,  i.e.  (^IYqi  U)  ~  N(/i,  US),  (yi^u  I U) 

/°1,0 

sequences  {uj^  and  {w^  J  are  independent,  (U  |  yg)  ~  IG  [-^  , 
above  case,  we  have 


~  N(0,  UUj^jj),  given  U 


similar  to  the 
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@1 

^^iyi.2 

vjl) 

yo-u 

~N 

™yi.i 

,  U 

^yi.i2 

vf) 

“yi.2 

^yi.2^1^1-21 

^yi.2 

. 

. 

- 

- 

^^lyi.i 

^^iyi.2 

Y^l) 

Yo 

'■^”1,0 

“yi.i 

’  °1,0 

^yi.1^1 

^1.1 

^1.12 

yJ2) 

. 

“yi.2 

^yi.2^1 

^yi.2i 

^yi.2 

where  all  submatrices  are  specified  as  the  same  as  under  scenario  A. 

0  \ 

Applying  proposition  3  to  the  distribution  of  ^  ^^2)  I  YO’  ?fl,t)’  obta.in 

(U  I  h'  yi,t  )  ~  (  "1^  ’  4^)  ’ 


where 


^l,t  =  +  “  "^1,0  +"^1,1’ 

'I'l.t  =  (yi,t  -  “yi,/  <?i,t  -  “yi.i)  ■ 
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A2.  Derive  the  inference  and  forecasting  formulae  of  Y£. 

The  model  formulating  is 

J-  =  *’t  +  "«,t’ 

Vt  "  •*£,t 

where 


®£,t  “ 


cp) 


>  t  ~ 


0  0 

0  (i-r^) 


G<“> 

g('2)  1 

Gt  = 

t 

partitioned  corresponding  to  — 

G^l) 

gP> 

r.  is  a  diagonal  matrix  with  entries  taking  values  between  0  and  1,  when  £-1, 


From  the  second  equation  of  model  (A.2)  turns  out 

»«,t  =  H*,!- *«,o  +  “e,!  hi  hi,i  +  ■•■  +  h,t  hi,<. 
+  3 ’e.2  +■  + 

=  ■‘•eAi’  ■  .Ai 
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Therefore,  0^  =  [9'^  q  ’  <^£,1  ’  ’  ^e,V  '  V  ^  ® 

M£  specified  as 


0 

w 


£,n 


,  with  Lg,  S, 


L£  _ 


H 


£,1 


®£,2®£,1 


’£,1 


®£,2**£,1 


'£,2 


®£,n"-H£,l  H£,n"-H£^2'*£,l  ®£,n  '  ‘  ‘  ®£,3’^£,2  ‘ '  '^£,ii 


I 

I 

H£,1  I 

®£,1 

II 

'S^ 

^£,2  ®£,1  * 

•  •  t  *  . 

,  s  = 

®£,2®£,1 

•  •  •  • 

®£,n‘®£,l 

- 

■ 

Thus  under  scenario  A,  i.e. 

(®£-l  I  y£-l)  ~  C£_i),  U£^jj  ~  N(0,  J,  ~  N(0,  J, 

(^0ly£-l)  =  (^£-l,oly£-l)  +  ®£,0’  8£,o  ^ 

{u£  J,  {w£  J  and  |  y^.j}  are  mutually  independent, 

applying  proposition  1,  we  obtain  the  prior  joint  distribution 


e, 

Btt/j 

Cfl 

^^£^£.1 

^^£^£.2 

yj'> 

y£-i 

~N 

niv 

^£.1 

» 

^y£.l^£ 

^y£.i 

^^£.12 

Yf) 

^£,2 

^y£.2^£ 

^£.21 

^^£.2 
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where 


^£-1  +  «£•  (  j  ^  ™^£’ 


^Oi  ~  ^l  ^  W,  ’ 

t  £,n 

{%y,y  ‘^'’‘''<■2^  ° 


^^£.1  S.12 

^^£.21  ^^£.2 


*’'c.  . 


Applying  proposition  2  to  above  prior  joint  distribution  yields  the  conditional  distribution  of 
and  given  observations  y^  as 


/«£  ,.  ^  Mfl  £  W  «  £^«-2 

(yJ2)  I  ?«■?<.«)- 


^^£  ^^£^£.2 


where 


h  ^^£^£.1  ^‘^^£.1^'^ 

^£.2  +  ''y£.2i  -  “y£.i)- 


“y£.2  “y£.2  ^y£.2i  ^^y£.i 


^0£  ^^£y£.2 


^y£.2^£^y£.2 


^^£  ^£y£.2  V  /  V£.l 


^y£.2^£  ^^£-2 


)-(c 
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In  particular,  we  have  the  following  joint  predictive  distribution: 


I  U-v  ~  ^^*y£.2  ’  ^y£.2^' 


Under  scenario  B,  i.e.  I  Yg-it  U)  ~  N(mg_j,  UC£_2^), 

(y£,nlU.y£-l)  ~  N(0,  UUg  J,  I  ^1’ U)  ~  N(0,  UW^  J, 

(Diui)  -  “(¥■  % 

given  U  sequences  {u^  J,  {w^^J  and  1  y^.^}  ate  mutually  independent, 


we  have  the  following 


Sj 

^^£  ^^£y£.l 

^^1^1.2 

tl-V  u 

~  N 

“y£.i 

,  U 

S£.i^£^y£.i 

^y£.i2 

vf) 

“y£.2 

^y£.2^£^^«-21 

^£.2 

- 

-j 

“ 

e« 

niA 

h 

^V£.l 

^^£y£.2 

yS^) 

y£-i 

~  ^“£,0 

niv 

y£.i 

^^£,0 
’  °£,0 

^y£.l^£ 

^y£.i 

^£.12 

Yf> 

m„ 

y£.2 

^y£.2^£ 

^y£.2i 

^£.2 

_ 

. 

. 

- 

- 
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where 


“y£./ 


y^  (y£,t 


~  “y£.i^’ 


all  submatrices  are  specified  as  the  same  as  under  scenario  A. 
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